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ABSTRACT 


Reed-Muller  codes  are  known  to  be  some  of  the  oldest,  simplest  and  most  elegant 
error  correcting  codes.  Reed-Muller  eodes  were  invented  in  1954  by  D.  E.  Muller  and  I. 
S.  Reed,  and  were  an  important  extension  of  the  Hamming  and  Golay  eodes  because  they 
gave  more  flexibility  in  the  size  of  the  eodeword  and  the  number  of  errors  that  could  be 
eorreet. 

The  eovering  radius  of  these  eodes,  as  well  as  the  fast  eonstruetion  of  eovering 
eodes,  is  the  main  subjeet  of  this  thesis.  The  eovering  radius  problem  is  important  beeause 
of  the  problem  of  eonstructing  eodes  having  a  speeified  length  and  dimension.  Codes  with 
a  reasonably  small  eovering  radius  are  highly  desired  in  digital  eommunieation 
environments. 

In  addition,  a  new  algorithm  is  presented  that  allows  the  use  of  a  eompaet  way  to 
represent  Reed-Muller  eodes.  Using  this  algorithm,  a  new  method  for  fast,  less  eomplex, 
and  memory  effieient  generation  of  U*  and  order  Reed  -  Muller  eodes  and  their 
hardware  implementation  is  possible.  It  is  also  allows  the  fast  eonstruetion  of  a  new 
subeode  elass  of  2"*^  order  Reed-Muller  eodes  with  good  properties.  Finally,  by  reversing 
this  algorithm,  we  introduee  a  eode  eompression  method,  and  at  the  same  time  a  fast, 
efficient,  and  promising  error-correetion  proeess. 
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EXECUTIVE  SUMMARY 


Error-Correcting  codes  play  a  vital  role  in  every  real  digital  communication 
environment  and  storage  process.  Reed-Muller  codes  are  among  the  oldest,  simplest  and 
most  elegant  error-correcting  codes.  When  information  is  sent  through  a  network  over 
long  distances  or  through  a  variety  of  channels,  where  errors  might  occur  in  the  transition, 
error-correcting  codes,  like  Reed-Muller  codes,  can  correct  these  errors.  This  correction 
process  provides  our  network  with  an  improvement  in  throughput  and  efficiency. 
Therefore,  the  efficient  use  of  these  codes  is  more  than  a  critical  issue. 

A  contribution  of  this  thesis  is  a  new  way  of  fast  generation  of  E*  and  order 
Reed-Muller  codes  and  a  category  of  order  subcodes.  In  addition,  this  new  algorithm 
allows  a  compact  way  to  represent  E*  and  2“‘*  order  Reed-Muller  codes. 

This  expansion  algorithm  is  appropriate  where  the  fast,  real-time  generation  of  low 
order  Reed-Muller  codes  needed.  Using  this  highly  compressed  form  of  codewords,  we 
can  quickly  expand  to  any  full  codeword.  In  this  thesis,  we  also  demonstrate  the  hardware 
implementation  for  this  algorithm. 

It  is  also  shown,  that  using  just  eight  blocks  of  4-bits,  all  E*  order  Reed-Muller 
codes  can  be  quickly  generated.  In  addition,  for  2"‘*  order  Reed-Muller  codes,  a  new 
concatenation  method  using  all  sixteen  possible  4-bit  combinations  is  presented.  Finally, 
using  eight  4-bits  words,  we  can  quickly  construct,  a  new  category  of  subcodes  of  2"*^ 
order  Reed-Muller  code  with  minimum  distance  (/=8  and  some  other  good  properties. 

Additionally,  it  is  proven  in  this  thesis,  that  the  format  of  the  Algebraic  Normal 
Form  of  our  fast  construction  of  2"‘*  order  Reed-Muller  subcodes  is  affine +  x^_^x^. 

Combining  this  property  with  the  low  distance  of  these  subcodes,  makes  them  worthy  for 
further  investigation  concerning  their  performance. 

In  addition,  by  reversing  the  new  algorithm,  we  demonstrate  a  new  efficient  way  to 
correct  errors  occurring  in  this  word.  This  is  equivalent  to  compressing  the  received  word. 
The  “reverse”  algorithm  applies  to  cases  of  storage  processes  and  to  communication- 
oriented  applications  where  Automatic  Response  Request  (ARQ)  is  used. 


XV 


Furthermore,  the  state  of  the  art  of  the  covering  radius  problem  for  Reed-Muller 
codes  is  presented  in  this  thesis.  This  has  been  the  subject  of  investigation  for  many 
researchers  in  the  area,  and  a  complete  resolution  of  the  problem  still  eludes  us.  Some 
recently  found  results  of  estimates  of  covering  radius  of  Reed-Muller  codes  are 
summarized  and  presented.  Some  of  the  methods  of  computations,  even  without  using  the 
help  of  computers  are  also  presented.  In  addition,  the  main  properties  of  Reed-Muller 
codes  are  analyzed. 

The  covering  radius  problem  is  very  important  since  it  gives  insight  into  the 
practical  problem  of  constructing  codes  having  a  specified  length  and  dimension. 

Based  on  the  analysis  of  this  thesis,  we  conclude  that  the  proposed  methods  of 
fast  and  memory  efficient  low  order  Reed-Muller  codes,  as  well  as  some  category  of 
subcodes  of  order  Reed-Muller  codes,  is  quite  challenging  and  promising. 
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I.  INTRODUCTION 


A.  THESIS  OBJECTIVE 

A  binary  code  C  of  length  n  is  a  nonempty  subset  of  the  set  of  all  binary  n-tuples. 
The  (Hamming)  distance  between  two  eodewords  is  the  number  of  bits  in  which  they 
differ.  The  covering  radius  of  a  code  C  is  the  smallest  integer  R  such  that  every  binary 
vector  of  length  n  is  within  distance  R  from  at  least  one  codeword.  In  other  words,  the 
space  of  all  binary  n-tuples  is  completely  eovered  by  spheres  of  radii  R  having  centers  at 
the  codewords  of  our  code  C. 

The  covering  radius  is  one  of  the  most  important  properties  of  error  correcting 
codes.  It  will  be  elarified  throughout  this  thesis.  We  seek  codes  having  a  speeified  length 
and  dimension  with  reasonably  small  covering  radius;  in  this  way,  no  vector  of  the  spaee 
is  very  far  from  a  nearest  codeword. 

It  is  worth  mentioning  that  covering  radius  is  a  basie  geometric  parameter  of  a 
code.  Topics  that  are  currently  under  researeh  by  the  eoding  community  are  the 
following: 

1.  Given  the  length  and  dimension  of  a  linear  code,  it  should  be 
determine  what  the  covering  radius  is. 

2.  Construet  efficient  codes  that  have  small  covering  radius. 

3.  Develop  eomputational  methods  to  determine  the  eovering  radius 
of  well-known  error-correetion  codes. 

Specifically,  Reed-Muller  codes  are  an  extremely  interesting  class  of  error- 
correction  codes,  and  therefore,  many  researehers  have  studied  Reed-Muller  eodes. 
Nevertheless,  due  to  the  complexity  of  computations  methods,  overall  knowledge  is  still 
quite  limited.  We  will  foeus  on  some  of  these  methods  and  point  out  all  published  results 
of  covering  radius  of  1,®* ,  and  k-th  order  Reed-Muller  codes. 

We  survey  the  main  properties  of  the  Reed-Muller  codes,  investigate  previous 
methods  for  the  computation  of  covering  radius,  and  propose  a  fast,  less  complex,  and 
memory  efficient  algorithm  to  derive  H*  and  2“‘*  order  Reed-Muller  codes,  as  well  as  a 
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subcode  of  2“‘*  order  Reed-Muller  code  with  good  properties.  This  new  algorithm  allows 
the  use  of  a  compact  way  to  represent  Reed-Muller  eodes. 

Reversing  the  new  algorithm,  in  other  words,  eompressing  the  eodewords  of  low 
order  Reed-Muller  codes  and  of  a  new  subcode,  we  introduce  an  efficient  way  to  eorreet 
errors  oecurring  in  any  codeword  of  these  eodes.  The  hardware  implementation  of 
expansion  algorithm  is  presented,  and  analyzed. 

B,  THESIS  OUTLINE 

This  thesis  is  organized  as  follows:  we  start  with  the  introduction,  background 
(Chapter  II)  and  four  additional  ehapters.  Chapter  III  eontains  a  detailed  analysis  of  Reed- 
Muller  codes,  some  applications  of  these  codes,  and  generation/eneoding/decoding 
methods.  In  Chapter  IV,  the  covering  radius  is  defined  and  its  importance  in  error 
correetion  is  discussed.  Some  important  methods  of  computations  are  discussed.  Further, 
in  this  ehapter,  some  existing  covering  radius  results  coneerning  C*,  and  k-th  order 
Reed-Muller  codes  are  presented.  In  Chapter  V,  we  develop  a  new  algorithm  for  fast 
generation  of  C*  -  2"‘*  order  Reed-Muller  codes,  and  a  new  construetion  of  a  subeode  is 
analyzed.  The  hardware  implementation  of  this  algorithm  is  also  presented  and  analyzed. 
In  addition,  a  “reverse”  of  this  new  algorithm  is  presented  and  evaluated.  In  Chapter  VI, 
the  conclusions  based  on  the  observations  obtained  from  the  analysis  in  the  previous 
ehapters  are  presented,  as  well  as  proposed  future  work. 
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II.  BACKGROUND 


In  this  chapter,  some  baekground  knowledge  and  concepts  for  the  analysis  of 
Reed-Muller  codes  and  their  subeodes  are  introduced. 

A,  DEFINITIONS 

1,  Groups 

A  group,  denoted  by  [G]  =  (G,*)  is  a  set  of  elements  G  combined  with  a  binary 
operation  *  on  G,  satisfying  the  following  conditions: 

a.  Closure 

'da,b  e  G;a*b  =  c  e  G 

b.  Associativity 

\fa,b,c  e  G;a*(Z?*c)  =  (a*Z?)*c 

c.  Identity 

3eGG|VaeG;e*a  =  a*e  =  a 

d.  Invertibility 

Va  e  G, e  G  |  a  *  *a  =  e 

Groups  that  also  satisfy  the  following  commutative  property  are  referred 
to  as  commutative  or  Abelian  groups. 

e.  Commutativity 

'd  a,b  ^G\a*b  =  b*  a 

2,  Fields 

A  field,  denoted  [F]  =  (F,+,*)  ,  is  a  set  of  elements  F  eombined  with  two 
binary  operations  +  and  *  on  F,  satisfying  the  following  conditions: 
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a.  Group  Under  Addition 

(F,+)  is  an  Abelian  group  with  identity  0. 

b.  Group  Under  Multiplication 

is  an  Abelian  group  with  identity  1 . 

c.  Distributive  Law 

\fa,b,c  eF;a*(h  +  c)  =  (a*h)  +  (a*c) 

In  this  thesis,  all  manipulations  will  be  on  the  two-element  (binary)  field, 
Fj  =  {0, 1}  in  whieh  the  usual  operations  of  addition  and  multiplieation  modulo  2  hold: 

Table  1.  Addition  in 


-1- 

0 

1 

0 

0 

1 

1 

1 

0 

Table  2.  Multiplieation  in 


* 

0 

1 

0 

0 

0 

1 

0 

1 

3,  Vector  Space 

A  vector  space  over  a  field  F  is  a  non-empty  set  V  together  with  two  binary 
operations: 
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Addition,  denoted  by  +. 

Scalar  multiplication,  denoted  by  juxtaposition,  is  a  function  from  F  x  V  to  V; 
that  is  the  scalar  product  of  a  e  F  and  x  eF  is  written  as  ax . 

Furthermore,  these  two  operations  satisfy  the  following  conditions: 

Closure  under  vector  addition, 

Vu,veF;u+v  =  weF 

Closure  under  scalar  multiplication, 

Vm  e  F,  Va  e  F;aM  =  V  e  F 

Associative  law  for  vector  addition, 

VM,v,H’eF;  u  +  {v  +  w)  =  {u  +  v)  +  w 

Commutative  law  for  vector  addition, 

Vm,v  e  F;m  +  v  =  v  +  m 

Identity  element  in  addition, 

30eF|VMeF;M  +  0  =  M 

Additive  inverse, 

Vm  e  F,3(-m)  eV;u  +  (-u)  =  (-u)  +  u  =  0 

Distributive  law  for  scalar  multiplication  over  vector  addition, 

yu,v  eV,ya  e  F;a(^u  +  v)  =  au  +  av 

Distributive  law  for  vector  multiplication  over  scalar  addition, 

Vu  e  V,ya,b  eF;(a  +  h)  u  =  an +  bv 

Associative  law  for  scalar  multiplication  with  a  vector, 

Vu  e  V ,\/a,b  e  F;(^ab)u  =  a{bu) 

Identity  element  in  vector  multiplication, 

3  leF;VMeF,lM=M 

The  vector  spaces  F  =  F^  used  in  this  thesis  consist  of  binary  strings  of 

length!"',  where  m  is  a  positive  integer,  with  the  usual  bitwise  operations,  described 
below.  The  codewords  of  the  Reed-Muller  codes  and  other  linear  subcodes  are  subspaces 
of  such  a  vectors  space  F. 

Vectors  in  such  spaces  can  be  manipulated  by  three  main  operations. 
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a.  Addition 

For  two  vectors  x  =  (xj,  Xj, ,  x„)  andj  =  (jj,  ••• ’F«)  >  addition  is 
defined  by,x  + j  =  (xj  +  j^Xj  +  +f„)  where  each  x.  or  y.  is  either  1  or  0.  The 

complement  x  of  a  vector  x  is  the  vector  equal  to  (1  1  1...  l)  +  x.  An  example  of  the 
complement  of  a  vector  is:  (0  0  0  1  1  1)  =  (0  0  0  1  1  1)  +  (1  1  1  1  1  1)  =  (1  1  1  0  0  0) 


b.  Vector  Intersection 

The  multiplication  of  a  vector  x  by  a  constant  a  e  Fj  is  defined 
^ya*x  =  (a*x„a*x2,...,a*x„)  .^0 *(111001)  =  (000000) 


c.  Dot  Product 

The  dot  product  of X  and y  is  x  □  y  =  Xj*yj +X2*y2 +-"  +  -^«  *  T«  • 

It  is  clear  that  addition,  vector  intersection  and  dot  product  require  vectors 
with  the  same  number  of  coordinates. 


B,  REVIEW  OF  BOOLEAN  FUNCTIONS 

A  Boolean  function  of  m  variables  (xj,X2,...,  x^)  is  a  function 
/(xj,X2,...,x^)from  to  F^,  where  F2  =  {0,1}.  This  kind  of  function  can  be 
completely  described  by  its  truth  table,  which  is  simply  the  sequence  of  its  outputs,  where 
the  input  is  ordered  lexicographically.  Precisely,  we  order  F^  as 

{vj  =  (0,0,..., 0),  V2  =  (0,0, .,(1,1,...,!)} ;  the  truth  table  of  /  is  the  sequence 
/(Vj),  /(Vj)...  Table  3  specifies  a  Boolean  function  of  four  variables. 
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Table  3. 


Truth  Table  of  a  Boolean  Function 


X, 

X2 

Xj 

X4 

/ 

0 

0 

0 

0 

1 

0 

0 

0 

1 

1 

0 

0 

1 

0 

1 

0 

0 

1 

1 

0 

0 

1 

0 

0 

1 

0 

1 

0 

1 

0 

0 

1 

1 

0 

0 

0 

1 

1 

1 

0 

1 

0 

0 

0 

0 

1 

0 

0 

1 

1 

1 

0 

1 

0 

1 

1 

0 

1 

1 

1 

1 

1 

0 

0 

0 

1 

1 

0 

1 

0 

1 

1 

1 

0 

0 

1 

1 

1 

1 

1 

From  the  right  most  column  of  this  table  (beginning  from  top),  we  get  the  binary 
string  (truth  table)  1110100001110001  of  length  16.  For  m-variable  functions,  this  string 
has  length  2"" . 

The  two  constant  Boolean  functions  are  (xi,X2,...,  =  (1,1,...,1) 

and(xpX2,...,x^)  =  (0,0,...,0).  In  this  thesis,  two  logical  operations  are  used  on  Boolean 
functions:  conjunction  (that  corresponds  to  multiplication  in  F^)  and  exclusive  OR,  or 
xor  (that  corresponds  to  addition  in  F^).  Consequently,  the  string  versions  of  these 
operations  are  given  by: 

(xi,X2,...,x„)  conjunction  {y^,y2,...,yJ  =  {x^,X2,...,xJn{y^,y2,...,y^)and 


(xi,X2,...,x„)  exclusive  OR(yi,y2,...,  y„)={xi^2 


7 


It  is  obvious  that,  under  the  exelusive  OR  operation,  the  set  of  Boolean  funetions 
of  m  variables  forms  a  vector  space  over  Fj ,  of  size  2^  . 

In  addition,  a  Boolean  monomial  with  variables  Xj,X2,...,x^  is  an  expression  of 

the  form/)  =  x.x,.  ...x.  .  The  reduced  form  of  p  is  obtained  using  the  rule:  x^.  =x.  until 

the  factors  become  distinct.  The  degree  of  p  is  the  number  of  variables  in  the  reduced 
version  of  p. 

An  example  of  a  Boolean  polynomial  in  reduced  form  of  degree  three 
is  /) '  =  Xj  +  Xj  +  X3  +  XjXjXj . 

On  the  other  hand,  a  Boolean  polynomial  is  a  linear  combination  of  Boolean 
monomials,  with  coefficients  inFj.  A  reduced  polynomial  is  obtained  using  the  rule: 
a+a=0,  until  all  the  monomials  become  distinct. 

Since  there  are  distinct  Boolean  monomials  of  degree  k  on  m  variables,  the 

total  number  of  distinct  Boolean  monomials  is  2”,  and,  therefore,  the  total  number  of 

distinct  Boolean  polynomials  in  m  variables  is  2^  . 

At  this  point,  we  need  to  associate  a  Boolean  monomial  in  m  variables  to  a  vector 
with  2"'  elements.  The  degree-zero  monomial  is  1,  and  the  degree-one  monomials 
areXj,X2,...,  andx^ .  First,  we  define  the  vectors  associated  with  these  monomials.  The 

vector  associated  with  the  monomial  1  is  simply  a  vector  of  length  2'",  whose 
components  are  all  1 .  So,  in  a  space  of  size  2"* ,  the  vector  associated  with  1  is 
(1111111111111111).  The  vector  associated  with  the  monomial  Xj  is  2'"  '  I's,  followed 

by  2'"  '  O's.  The  vector  associated  with  the  monomial  X2  has  2“^^  I's,  followed  by  2“^^ 

O's,  then  another  2'”^^  I's,  followed  by  another  2"’^^  O's. 

In  general,  the  vector  associated  with  a  monomial  x,  is  a  pattern  of  2”  '  ones 

followed  by  2"’ '  zeros,  repeated  until  2“  values  have  been  defined.  For  example,  in  a 
space  of  size  2"' ,  the  vector  associated  with  is  (1010101010101010). 
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C.  AFFINE  BOOLEAN  FUNCTIONS 

An  affine  Boolean  funetion  of  m  variables  is  a  funetion 

/(Xi^2,...,X„)=/o  +  E  yix.  from  F”  to  ,  where  the  eoeffieients  f.  belong  to 

\<X<m 

Fj  =  {0, 1}  .  The  set  of  all  n-variable  affine  funetions  is  denoted  by  .  As  we  mentioned 
previously,  in  Table  4,  the  truth  tables  of  every  3-variable  affine  funetion  is  shown. 


Table  4.  Truth  Table  of  an  Affine  Boolean  Funetion 


Affine  Function 

Truth  Table 

0 

00000000 

Xi 

00001111 

X2 

00110011 

X3 

01010101 

Xj  +X2 

00111100 

Xj  +X3 

01011010 

X2  +X3 

01100110 

Xj  +  X2  +  X3 

01101001 

1 

11111111 

1  +  Xj 

11110000 

1+X2 

11001100 

1  +  X3 

10101010 

1  +  Xj  +  X2 

11000011 

1  +  Xj  +  X3 

10100101 

1  +  Xj  +  X3 

10011001 

1  +  Xj  +  Xj  +  X3 

10010110 
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In  Chapter  IV  the  importance  of  affine  Boolean  functions  in  conjunction  with 
Reed-Muller  codes  is  clarified. 

D.  NONLINEARITY  AND  BENT  FUNCTIONS 

The  nonlinearity  of  a  Boolean  function  /  is  defined  as 
N{f)  =  mm{d{f,/3)\/3eA^^},  where  d  (Hamming  distance)  is  the  number  of  different 
coordinates  of  vectors  in  which / differs  from  fi.  It  is  known  (see  [1])  that  the  nonlinearity 

-1 

is  upper  bounded  by:  N{f)  <  2"  -2^  .  The  concept  of  nonlinearity  is  a  very  important 
cryptographic  property. 

The  Boolean  functions  on  an  even  n  number  of  variables,  whose  nonlinearity  is 
maximum,  are  called  bent  functions.  The  importance  of  bent  functions  is  due  to  their 
correspondence  to  the  words  of  length  2”  whose  distance  to  the  C'  order  Reed-Muller 
codes  is  equal  to  the  covering  radius  of  this  code.  Bent  functions  play  a  significant  role  in 
cryptographic  environments. 

E.  HAMMING  DISTANCE  AND  HAMMING  WEIGHT 
1,  Definition 

Let  x  =  (xj,X2,..., x„)and  y  =  (ti,T2V5T„)  be  two  vectors  inF".  The  Hamming 

distance  d{x,y),  between  x  and  y  is  the  number  of  coordinate  places  in  which  they  differ. 
For  a  fixed  length  n,  the  Hamming  distance  is  a  metric  on  the  vector  space  of  the  words 
of  that  length.  For  words  of  length  3  and  4,  Figures  1  and  2  can  be  used  for  calculating 
this  Hamming  distance. 


3-bit  binary  cube  for  finding  Hamming  distance  (From  [2]). 
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Figure  1. 


6/(1 100, 0010)  =  3 


Figure  2.  4-bit  binary  hypercube  for  finding  Hamming  distance  (From  [2]). 

In  this  thesis,  we  will  refer  to  the  Hamming  distance  as  distance  since  it  is 
nonnegative,  symmetric,  and  triangular; 

d  (x,  y)  >  0  and  d  (x,  y)  =  0  iff  x=y 

d  (x,  y)  =  d  (y,  x)  for  all  x,y  in  F” 

d  (x,  y)<d  (x,  z)  +  d  (z,  y)  for  all  x,y,z  in  F" 

2,  Definition 

Hamming  weight  of  a  binary  word  w  is  the  number  of  "1"  bits  in  w.  For  example 
wt(ll  100101 110)=7. 

F.  ERROR  DETECTING  AND  CORRECTING  CAPABILITIES  OF  CODES 

Having  defined  the  Hamming  distance  of  two  vectors,  we  can  now  clearly 
describe  the  distance  of  a  code  C  as  the  minimum  distance  between  any  two  valid 
codewords  of  this  code. 

1,  Definition 

Let  Cbe  a  code.  Then,  d(C)=min{d(x,y)  |  x,  ye  C}. 

2.  Definition 

A  code  C  is  exactly  t-error-detecting  if  and  only  if  d (C)  =  1  +  1  and  t-error- 
correcting  if  and  only  if  d (C)  =  21  +  1  or  d (C)  =  2l  +  2  . 
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G.  CHAPTER  SUMMARY 

In  this  chapter,  we  discussed  the  basic  principles  and  properties  of  the  error 
correetion  codes,  and  the  baekground  and  important  concepts  neeessary  to  understand 
their  performance.  In  Chapter  III,  Reed-Muller  eodes  and  their  properties,  as  well  as 
encoding-decoding-generation  methods  will  be  introduced  and  analyzed. 
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III.  REED-MULLER  CODES 


A,  DEFINING  REED-MULLER  CODES 


Let  0<r<m.  The  r-th  order  Reed-Muller  code  R(r,m)  is  the  set  p  of  all  binary 
strings  of  length  n  =  2"‘  assoeiated  with  the  Boolean  polynomials  of 

degree  at  most  r. 

Consequently,  the  Q-th  order  Reed-Muller  code  R{Q,m)  eonsists  of  the  binary 
strings  assoeiated  with  the  eonstant  polynomials  0  and  1 .  This  eode  is  the  repetition  code 
oflength2“,i?(0,m)  =  {0"',r}  =  {0  0...0,  1  1...1}  =  Rep(2"’) . 

The  other  extreme  situation  is  the  m-th  order  Reed-Muller  eode  R{m,m), 
eonsisting  of  all  binary  strings  of  length  2“ ,  that  is,  R{m,m)=  ,  where  n  =  2”  . 


The  number  of  eodewords  ean  be  found  easily  from  the  eount  of  binary 

I  fn  I  I  fn  I  I  fn  1 

monomials  in  R{r,m)  of  degree  at  most  r.  There  are  k  =  \  +  \  +  +•••+  sueh 


monomials,  and  so  there  are  2*  linear  eombinations  of  these.  It  is  obvious  that  the  eloser 
r  is  to  m  the  more  eodewords  there  are.  In  eonelusion,  the  r-th  order  Reed-Muller  code 
R{r,m)  has  the  following  properties: 

Length  of  codewords:  I”' 

i+(“]+(“ 

Number  of  codewords:  2  ^  ^ 

Minimum  distance  between  codewords:  2”'^''  [3] 


Reed-Muller  eodes  are  among  the  most  useful  and  interesting  binary,  linear,  bloek 
eodes.  As  we  will  diseuss  in  the  next  paragraph,  first  order  Reed-Muller  eodes  of  length 
32  were  used  in  spaee  missions.  In  order  to  aehieve  greater  performanee  than  these  eodes 
offer,  we  have  to  extend  their  length.  The  limited  bandwidth  of  eommunieation  ehannels 
is  one  thing  that  we  have  to  take  into  aeeount.  Therefore,  the  use  of  very  large  eodes  in 
narrow  ehannels  is  prohibited.  On  the  other  hand,  Reed-Muller  eodes  of  higher  order 
require  signifieantly  less  bandwidth  than  the  first  order  ones. 
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Many  researchers  have  investigated  the  weight  distribution  of  Reed-Muller  codes, 
that  is,  the  sequence  of  codeword  weights.  The  weight  spectrum  for  the  first  order  Reed- 
Muller  codes  is  found  easily,  since,  as  we  will  see  in  the  next  chapter,  all  codewords  in 
R(l,m)  codes  have  the  same  number  of  O’s  and  I’s  (are  balanced)  except  for  the  all  O’s 
and  all  I’s  codewords.  For  example,  in  R(l,5),  there  are  2'^^  =  2®  =  64  codewords  of 
length  2^  =  32  .  Among  them,  there  is  a  codeword  of  32  1  ’s,  a  codeword  of  32  O’s  and  62 
codewords  of  weight  16  (half  1  ’s,  half  O’s). 

Understanding  the  weight  distribution  for  higher  order  Reed-Muller  codes  is 
complicated,  and  very  little  is  known  about  that.  Much  work  has  been  done  on  2”‘*  and  3'^‘* 
order  Reed-Muller  codes  [4]. 

B,  APPLICATIONS  OF  REED-MULLER  CODES 

The  first  order  Reed-Muller  codes  was  used  by  Mariner  9  to  transmit 

black  and  white  photographs  of  Mars  in  1972  [5].  A  simplified  example  giving  a  flavor  of 
code  use  in  digitally  transferred  data  is  given  below. 

The  main  idea  behind  applying  coding  in  digital  technologies  is  to  break  up  a 
picture  or  a  sound  into  small  pieces  and  to  use  a  binary  sequence  to  represent  each  of 
these  small  pieces,  adding  at  the  same  time,  some  redundant  bits.  This  redundancy  is  used 
to  correct  errors  that  might  be  caused  by  noise  when  the  information  is  sent  over  a  noisy 
channel. 

For  example,  the  pixels  (picture  elements)  shown  in  Figure  3  could  be  sent  via  a 
channel  by  coding  a  white  pixel  with  111111,  a  black  pixel  with  000000  and  a  gray  pixel 
with  111000.  Assuming  that  the  receiver  knows  the  size  of  the  image,  in  this  example 
6x6,  and  that  the  pixels  are  being  sent  row  by  row,  then  the  picture  can  be  accurately 
decoded  if  no  more  than  one  error  occurs  during  the  transmission  process.  This  happens 
because  the  distance  between  any  pair  of  codewords  is  at  least  3. 
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Figure  3. 


Picture  Elements. 


In  the  case  of  Mariner  9,  the  actual  scenario  is  more  complicated  and  finally  the 
error-correcting  code  used  is  “heavier.”  This  means  that  the  additional  bits  used 
(redundant  bits)  are  repeated  information  bits.  In  the  case  of  Mariner  9,  the  codewords 
were  32  bits  long,  consisting  of  6  information  bits  and  26  additional  bits. 

Another  significant  application  of  error-correcting  codes  is  in  the  compact  disc 
(CD)  technology  [5].  On  CDs,  the  signal  is  encoded  digitally.  To  protect  from  errors 
because  of  scratches,  cracks  and  similar  damage,  several  kind  of  codes  are  used  which 
can  correct  up  to  4,000  consecutive  errors  (about  2.5  mm  of  track).  Similar  error 
correction  techniques  are  also  used  on  DVDs  and  Blue-Ray  discs. 

We  cannot  ignore  the  contribution  of  codes  in  compression.  Compression  is  the 
process  of  transforming  information  from  one  representation  to  another  smaller 
representation.  In  many  cases,  compression  and  decompression  processes  are  often 
referred  to  as  encoding  and  decoding.  It  is  obvious  that  data  compression  has  application 
to  data  storage  and  data  transmission.  Since  using  a  process  of  reducing  the  amount  of 
data  required  to  represent  a  given  quantity  of  information,  different  amounts  of  data 
might  be  used  to  communicate  the  same  amount  of  information.  If  the  exact  information 
can  be  represented  with  different  amounts  of  data,  it  is  reasonable  to  believe  that  the 
representation  that  requires  more  data  contains  some  kind  of  data  redundancy.  Image 
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compression  and  coding  techniques  use  three  types  of  redundancies:  coding  redundancy, 
spatial  redundancy,  and  psychovisual  redundancy. 

Another  great  eoneern  of  coding  theory  is  synchronization.  In  many  industrial  and 
military  activities,  such  as  navigation,  mapping,  positioning,  power  distribution, 
teleeommunication,  weather  station,  and  digital  radio,  one  of  the  most  important 
exehanged  information  is  the  preeise  time  of  aetion  taking  place  (time  tag). 
Synchronization  between  these  tags  is  something  that  ean  be  fixed  and  controlled  by 
codes.  With  the  use  of  speeific  codes  any  “shift”  in  phase  of  a  signal  can  be  detected  and 
corrected,  enabling  the  transmission  of  multiple  signals  through  the  same  ehannel. 

C.  GENERATION/ENCODING  METHODS 
1.  Generation  Methods 

a.  Using  Boolean  Polynomials 

An  r-th  order  Reed-Muller  eode  R{r,m)  is  the  set  of  all  binary  strings  of 
length  2“  associated  with  Boolean  polynomials  x^Xj,..., of  degree  at  most  r. 

Consequently,  the  first  order  Reed-Muller  code  of  length  n  =  2^  is  the  set  of  all  binary 
strings  associated  with  the  Boolean  polynomials  Xj,  Xj,  and  Xj  of  degree  at  most  1. 
These  polynomials  have  the  form  +  ^3X3  where  a.  =0  or  1 .  The  binary 

string  corresponding  to  this  polynomial  is  (11111111) +  aj  (0000 1111) 
+a2(00110011)  +  a3(01010101). 

b.  Example  R(l, 3) 

We  can  list  the  codewords  inR(l,3)  as  follows: 
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Table  5. 


RM(1,3)  codewords 


Polynomial 

Codeword 

0 

00000000 

Xi 

00001111 

^2 

00110011 

X3 

01010101 

Xj  +X2 

00111100 

Xj  +X3 

01011010 

Xj  +X3 

01100110 

X,  +  Xj  +  X3 

01101001 

1 

11111111 

1  +  Xj 

11110000 

1+X2 

11001100 

1  +  X3 

10101010 

1  +  Xj  +  Xj 

11000011 

1  +  Xj  +  X3 

10100101 

1  +  Xj  +  X3 

10011001 

1  +  Xj  +  Xj  +  X3 

10010110 

Note  that  all  codewords  in  R{\,m)  except  0  and  1  have  weight  2“  ' .  Thus, 
in  the  previous  example  of  R(l,3),  the  weight  of  all  nontrivial  codewords,  except 
00000000  and  1 1 1 1 1 1 1 1,  is  2'  '  =  4 . 

c.  Using  Direct  Sum  Construction 

If  Cjis  an  i?^^'’^'^code  and  an  code,  then  the  direct  sum 

is  the  code  ~  |  c  e  Cj,  J  e  C'j}  following  parameters: 
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Length  of  codewords:  2"'  +  2"' 


Number  of  codewords:  2  ^  ^2 

Minimum  distance  between  codewords:  min{2“‘  '’,2'”' 


1+1  f  ■  +  ?  +■••+  "■  1+  +■■■+ 


1  r\2 


d.  Using  (u,u+v)-Construction 

This  construction,  for  many  reasons,  is  more  useful  than  the  direet  sum 
construetion.  If  Cj  is  an  i?(rj  eode  and  is  an  i?(r2  mf)  code,  both  of  whieh  are  over 

the  same  alphabet  (Cj  and  have  the  same  length),  then  we  ean  define  a  eode 
Cj  ©Cjby:  Cj  ©Cj  =  {c{c  +  d)  |  c  e  Cj,  J  e  C^)  with  the  following  properties  [5]; 


Length  of  codewords:  2'”'^'  =  2“"^' 


Number  of  codewords:  2  ' '  ' 
Minimum  distance 


between 


codewords: 


J(Ci  ©  C2)  >  min{2'”'-'''^',2“^-''^ } 


2,  Encoding  Methods 

To  define  the  eneoding  matrix  of  R{r,m),  let  the  first  row  of  the  eneoding  matrix 
be  11...  1  (the  veetor  with  length  2"'  with  all  entries  equal  to  1).  If  r  is  equal  to  0,  then 
this  row  is  unique  in  the  eneoding  matrix.  On  the  other  hand,  if  r  is  equal  to  1,  then  we 
add  m  rows  eorresponding  to  the  veetors  Xj,  X2,  ...  ,  and  x^to  the  R{0,m)  eneoding 
matrix. 

Thus,  in  order  to  form  an  R{r,m)  eneoding  matrix,  where  r  is  greater  than  1,  we 
have  to  add  j  rows  to  the  R{r-\,m)  eneoding  matrix.  These  added  rows  eonsist  of  all 

the  possible  redueed  degree  r  monomials  that  ean  be  formed  using  the  rows  x^Xj,...,  x^ 
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a.  Example  R(l, 3) 


When  m=3  we  then  have: 

b.  Example  R(2,3) 

Thus,  adding  the  rows 


1 

1 

1 

1 

1 

1 

1 

1 

1 

Xi 

1 

1 

1 

1 

0 

0 

0 

0 

X2 

1 

1 

0 

0 

1 

1 

0 

0 

X3 

1 

0 

1 

0 

1 

0 

1 

0 

XjXj  =11000000,  XjX3  =10100000  andxjXj  =10001000  we  obtain: 


1 

1 

1 

1 

1 

1 

1 

1 

1 

X, 

1 

1 

1 

1 

0 

0 

0 

0 

X2 

1 

1 

0 

0 

1 

1 

0 

0 

X3 

1 

0 

1 

0 

1 

0 

1 

0 

X,X2 

1 

1 

0 

0 

0 

0 

0 

0 

X,X3 

1 

0 

1 

0 

0 

0 

0 

0 

X2X3 

1 

0 

0 

0 

1 

0 

0 

0 

c.  Example  R(3, 3) 

Note  that,  the  row  XjXjXj  =  10000000  ean  be  added  to  form:  i?(3,3) 

d.  Example  R(2, 4) 

Using  exaetly  the  same  steps,  we  ean  obtain: 
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1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

Xi 

1 

1 

1 

1 

1 

1 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

X2 

1 

1 

1 

1 

0 

0 

0 

0 

1 

1 

1 

1 

0 

0 

0 

0 

X3 

1 

1 

0 

0 

1 

1 

0 

0 

1 

1 

0 

0 

1 

1 

0 

0 

X4 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

XjX2 

1 

1 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

XjXj 

1 

1 

0 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

X1X4 

1 

0 

1 

0 

1 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

X2X3 

1 

1 

0 

0 

0 

0 

0 

0 

1 

1 

0 

0 

0 

0 

0 

0 

X2X4 

1 

0 

1 

0 

0 

0 

0 

0 

1 

0 

1 

0 

0 

0 

0 

0 

X3X4 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

It  is  obvious  that  the  number  of  rows  of  these  eneoding  matriees  is 


k=\+  +  +...+  .  So,  the  sent  message  must  be  in  bloeks  of  length  k.  Let 

11  /  ,2  ,  ,r  , 


=  (m  be  sueh  a  block.  Then  the  encoded  message  M  is  the  sum^«r,J?; 


where  i?.  indicates  the  rows  of  the  encoding  matrix  of  R{r,m). 


e.  Example  Encoding  with  R(l,3) 

Using  i?(l,3)  to  encode  m=(001 1)  gives: 

0(1 1 1 1 1 1 1 1)  +  0(1 1 1 10000)  +  1(1 1001 100)  +  1(10101010)  =  (01100110)  as 
the  encoded  word. 


f.  Example  Encoding  with  R(2,4) 

Similarly,  using  R(2,4)  to  encode  m=(10101 1 10010)  gives: 

1*(1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1)+0*(1 1 1 1 1 1 1 100000000) +1*(1 1 1 100001 1 1 10000) +0*(1 1001 1001 1001 100) 
+1*(1010101010101010)+1*(1111000000000000)+1*(1100110000000000)+0*(1010101000000000) 
+0*(1100000011000000)+1*(1010000010100000)+0*(1000100010001000)  =  (0011100100000101) 
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3,  Decoding  Methods 

There  are  few  methods  for  deeoding  Reed-Muller  eodes.  In  this  thesis,  the  most 
widely  used  is  analyzed.  Decoding  is  more  complex  than  encoding.  The  theory  behind 
both  encoding  and  decoding  is  based  on  Hamming  distance  between  vectors. 

The  decoding  method  checks  which  row  R^  of  the  encoding  matrix  was  used  to 

form  the  encoded  message.  The  implementation  of  this  method  requires  the  use  of 
characteristic  vectors  of  the  encoding  matrix  rows.  In  order  to  find  the  characteristic 
vector,  we  work  on  the  monomial  r  associated  with  the  row  of  the  matrix.  After  that,  we 
take  the  set  of  all  x^  that  are  not  in  r,  but  only  in  the  encoding  matrix.  The  characteristic 

vectors  are  those  vectors  that  correspond  to  monomials  x. ,  x. ,  such  that  exactly  one  of  x^ 
or  X-  belongs  to  each  monomial  for  all  elements  of  the  set  of  all  x. .  The  dot  product  of 
these  characteristic  vectors  with  all  the  rows  of  the  used  code  matrix  yields  0,  except  the 
row  to  which  the  vector  corresponds. 

a.  Decoding  Algorithm 

This  method  is  precisely  described  in  the  following  three  steps  of  an 

algorithm  [3]; 

Step  1 

Choose  a  row  of  the  given  encoding  matrix  code  and  find 
2"'^''  characteristic  vectors  for  that  row.  Then,  form  the  dot  product  of  these  vectors  with 
the  encoded  message. 

Step  2 

Compute  the  majority  value  (either  1  or  0)  of  the  dot  products,  and  assign 

it  to  each  row. 

Step  3 

Executing  steps  1,  2  from  the  bottom  of  the  matrix  to  the  top,  multiply  the 
majority  value  assigned  to  each  row  by  its  corresponding  row.  Add  the  results  altogether, 
and  then  sum  this  up  to  the  received  encoded  message.  If  there  is  a  majority  of  l‘s  in  the 
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resulting  vector,  then  assign  1  to  the  top  row.  Otherwise,  if  there  is  a  majority  of  O’s,  then 
assign  0  to  the  top  row.  Adding  the  top  row,  multiplied  by  the  assigned  value,  leads  to  the 
original  encoded  message.  Using  this  algorithm,  it  is  obvious  that  we  can  identify  the 
errors  occurred  during  the  transmission  of  encoded  message.  The  vector  that  is  formed 
using  the  assigned  values  of  each  row,  from  the  top  row  all  the  way  to  the  bottom  row  of 
the  encoding  matrix,  is  the  original  message. 

b.  Example  of  Decoding  Using  R(l,3) 

Assuming  an  original  message  m=(01 10),  using  the  i?(l,3)  encoded  matrix 
we  get  the  encoded  message  M=(00111100).  As  it  is  already  mentioned,  the  distance  in 
this  code  is  2^  '  =  4 ,  and  therefore,  it  can  correct  one  error.  Assuming  that,  during 
message  transmission,  one  error  occurred  at  the  first  leftmost  bit,  the  encoded  message 
after  the  error  is  M -(101 1 1100).  The  characteristic  vectors  of  the  last  row  of  the  encoded 

matrix  are  XjX2,XjX2,XjX2  and  x^,X2 . 

The  vector  related  to  Xj  is  (11110000),  thus  Xj  is  (00001111).  Similarly, 
X2  is  (11001100),  and  thus  X2  is  (00110011).  Therefore,  XjX2  is  (11000000),  XjX2  is 

(00110000),  XjX2  is  (00001100)  and  Xj,X2  is  (00000011).  Computing  the  dot  product  of 
these  vectors  withM’,  we  get  the  values  1, 0,0,0  respectively,  leading  to  majority  value  of 
0  forxj .  Repeating  the  process  for  the  second  to  last  row  of  the  matrix,  we  get  the  values 

0,1, 1,1  respectively,  leading  to  majority  value  1  forx2.  Working  similarly,  we  conclude 
that  the  coefficient  of  Xj  is  also  1.  Adding  0*(10101010)  and  1*(1 1001 100)  and 

1*(1 1 110000)  we  get  M”=(001 1 1100).  Then,  we  notice,  that  adding  M’  and  M”  we  get 
(10000000),  which  has  more  O’s  than  I’s,  leading  to  0  for  the  coefficient  of  the  first  row 
of  the  used  matrix. 

Putting  together  the  four  coefficients  that  correspond  to  four  rows  0,1, 1,0 
we  get  the  original  message.  Additionally,  we  can  determine  the  position  of  the  error  at 
the  first  leftmost  bit. 
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D,  CHAPTER  SUMMARY 

In  this  chapter,  a  detailed  diseussion  of  Reed-Muller  eodes  was  presented.  Some 
methods  of  generation,  encoding  and  decoding  are  also  analyzed.  This  will  help  us  explain 
later  in  the  thesis  the  simplicity  of  a  new  method  of  fast  constmction  of  these  codes.  In 
addition,  some  examples  were  examined  to  help  understanding  each  method.  In  Chapter  IV, 
the  concept  of  covering  radius  is  presented,  and  several  methods  for  its  computation  are 
examined. 
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IV.  COVERING  RADIUS 


A,  INTRODUCTION 

We  can  trace  the  origin  of  error  correcting  codes  in  a  paper  from  the  1940s  by 
Claude  Shannon  [6],  who  proposed  some  error  detection/correction  techniques,  to 
achieve  error-free  communication  through  a  noisy  channel.  Data  to  be  sent  over  a  noisy 
channel  is  first  “encoded,”  plaintext  is  turned  into  a  codeword  by  adding  extra  data 
(redundancy).  This  enlarged  codeword  is  sent  via  the  communication  channel  and  the 
received  data  is  “decoded”  by  the  receiver.  The  critical  point  of  this  last  process  is  that 
the  decoded  data  has  to  be  as  close  as  possible  to  sent  data.  At  this  point,  covering  radius 
takes  its  role,  since  the  “quality”  of  the  code,  in  relation  to  the  channel,  depends  on  how 
small  the  code’s  covering  radius  is. 

In  coding  theory,  the  covering  radius  plays  a  critical  role  in  every  code.  In 
addition,  good  covering  codes  have  a  number  of  applications  in  various  areas  of 
mathematics  and  electrical  engineering.  Though  the  minimum  distance  has  a  more  central 
role  for  error-correction  codes,  the  covering  radius  is  also  related  to  the  error  correction 
capability  of  the  code,  since  if  it  is  less  than  the  distance,  no  vector  in  the  space  can  be 
added  without  worsening  the  code’s  distance  [7]. 

Since  has  a  distance  metric,  it  makes  sense  to  use  spheres  that  are  centered  at 

a  valid  codeword  x  with  a  given  radius  p.  One  sample  of  these  spheres  is  depicted  in 
Figure  4. 


Figure  4.  Sphere  of  radius  p. 
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Let  C  be  a  subset  ,  in  which  all  the  distances  are  integers.  The  covering 

radius  of  a  code  C  is  the  smallest  radius  p  (Figure  5)  such  that  every  word  of  the  space 
is  contained  in  some  (at  least  one)  sphere  of  radius  p  centered  at  a  codeword. 

It  is  obvious  that  the  covering  radius  problem  is  important  since  it  helps  in 
investigating  the  constructing  codes  having  a  specified  length  and  dimension  such  that 
no  vector  of  the  space  is  very  far  from  the  nearest  codeword. 


Figure  5.  Covering  radius  p. 

Each  codeword  of  a  code  C  a  represents  a  message.  When  that  message  is 

transmitted,  errors  may  occur.  However,  if  the  used  code  C  has  the  property  that  all  the 
spheres  of  radius  p  around  codewords  are  completely  disjoint,  then  any  received  message 
X  that  has  no  more  than  p  coordinates  in  error  is  within  distance  p  from  a  unique 
codeword  c  in  C.  Therefore,  we  conclude  that  the  codeword  that  was  originally  sent  is  c. 
Consequently,  we  say  that  C  can  correct  up  to  p  errors.  It  is  obvious  that  the  largest  value 
of  p  cannot  be  greater  than  d  (the  distance  between  any  two  codewords  of  C).  The  critical 
point  here  is  the  ability  of  constructing  error-correcting  codes,  having  specified  length 
and  dimension  (number  of  codewords  in  linear  cases)  with  large  minimal  d.  This  is 
actually  one  of  the  central  problems  in  theory  of  error-correction  codes. 

In  addition,  it  is  worth  mentioning  that  covering  radius  is  a  basic  geometric 
parameter  of  a  code.  Topics  that  are  currently  under  research  by  the  coding  community 
are  the  following: 
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1. 


Given  the  length  and  dimension  of  a  linear  eode,  it  should  be 
determined  what  the  eovering  radius  is. 

2.  Construet  effieient  eodes  that  have  small  covering  radius. 

3.  Develop  computational  methods  to  determine  the  covering  radius 
of  well-known  error-correction  codes. 

Specifically,  Reed-Muller  codes  are  an  extremely  interesting  class  of  error- 
correction  codes,  and  therefore,  many  researchers  have  studied  Reed-Muller  codes  [8], 
[9],  [10,  [11],  [12],  [13],  [14],  [15],  [16],  [17],  [18],  [19],  [20],  [21],  [22],  [23],  [24],  [25]. 
Nevertheless,  due  to  the  complexity  of  computations  methods,  overall  knowledge  is  still 
quite  limited.  We  will  focus  on  some  of  these  methods  and  point  out  all  published  results 
of  covering  radius  of  1,®*  2,"‘*  and  k-th  order  Reed-Muller  codes  later  in  the  chapter. 

B.  METHODS  OF  COMPUTATIONS  OF  COVERING  RADIUS 

1.  Method  Using  Translate 

When  we  construct  an  error-correction  code  with  large  minimum  distance  d,  our 
focus  is  in  the  structure  of  the  code.  In  addition,  the  corresponding  codewords  must  be 
chosen,  so  that  no  vector  of  F/  (since  in  this  thesis  we  only  work  with  binary  spaces)  has 
its  distance  too  large  from  any  codeword. 

On  the  other  hand,  the  design  of  a  decoding  scheme  focuses  on  the  exterior  part  of 
the  code.  If  we  have  a  code  C  a  ,  and  we  decide  to  send  some  data  in  the  form  of  a 

codeword,  then,  on  the  receiver  we  may  get  a  vector  x  that  is  different  from  c. 

Thus,  we  can  now  introduce  the  concept  of  a  translate  x  -l-  C  of  C.  This  is  the  set 
of  all  codewords  of  the  code  C  xoring  with  a  specific  received  word  x.  The  weight  of  the 
translate  x  +  C  is  the  minimal  weight  of  any  vector  in  C.  Knowing  the  weights  of 
translates,  is  very  critical  in  the  decoding  problem  since  the  covering  radius  is  the  largest 
among  all  weights  of  translates. 

In  the  following  example,  we  pick  the  code  C={00000,11000, 00111,11111},  and 
we  calculate  the  covering  radius  using  the  method  we  just  introduced  (see  Table  6).  Note, 
that  the  code  we  use  in  this  part  is  an  arbitrary  code  with  no  specific  properties.  We  use 
this  code  for  the  sake  of  simplicity  of  our  example. 
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Having  the  codewords  of  the  code  C  and  all  vectors  that  can  be  received  (received 
words),  we  can  calculate  the  translates  of  the  code,  and  thus  the  weights  of  these 
translates.  Therefore,  the  maximum  of  these  weights,  2  in  our  case,  is  the  covering  radius 
of  the  code.  In  Table  6,  we  see  this  method  in  detail. 

Table  6.  method  of  Covering  Radius  computation 


Codewords  of  C 

Vectors  X 

Minimum  wt(x+C) 

{Max[min(wf(x+C)]} 

(transmitted  words) 

(received  words) 

(x+C  translates) 

(covering  radius) 

00001 

1 

00010 

1 

00011 

1 

00100 

1 

00101 

1 

00110 

1 

00111 

0 

01000 

1 

01001 

2 

01010 

2 

01011 

1 

00000 

11000 

00111 

mil 

01100 

2 

01101 

2 

OHIO 

2 

2 

01111 

1 

10000 

1 

10001 

2 

10010 

2 

10011 

2 

10100 

2 

10101 

2 

10110 

2 

10111 

1 

11000 

0 

11001 

1 

11010 

1 

11011 

1 

11100 

2 

11101 

1 

mil 

0 

00000 

0 

Furthermore,  applying  the  same  method  to  the  following  code 
C’={00000,1 1000,001 11}  we  realize  that  even  though  we  decrease  the  dimension  of  the 
code  from  4  to  3,  the  covering  radius  remains  the  same.  This  code  is  actually  a  trivial 
sub-code  of  the  given  code.  In  reality,  constructing  a  sub-code  with  “nice  characteristics,” 
and  properties  is  not  a  triviality. 
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In  our  case,  the  eovering  radius  of  the  random  eode  is  2.  As  we  have  already 
mentioned  above,  the  eovering  radius  is  also  the  smallest  integer  r  sueh  that  any  veetor  in 
F"  is  within  distanee  r  from  a  eodeword. 

This  method  works  well  for  eodes  with  small  length  and  dimension.  When  these 
parameters  beeome  larger,  the  eomputation  eomplexity  of  the  method  inereases 
exponentially,  and  the  use  of  computers  is  neeessary. 

2.  2“‘'  Method  of  Using  Direct  Sum  of  Codes 

Before  we  deseribe  the  method  of  eovering  radius  eomputation  [11],  we  give 
several  definitions. 


a.  Definition  of  Norm  of  a  Code  C 

Let  C  cz  be  a  linear  eode  of  length  r,  dimension  m  and  eovering  radius 
R.  Let  j  be  one  of  the  m  eoordinates,  and  Cj  denote  the  set  of  eodewords  in  whieh  the  j- 
th  eoordinate  is  0.  Similarly,  let  Cj  denote  the  set  of  eodewords  in  whieh  the  y-th 
eoordinate  is  1.  In  aeeordanee  with  [22],  if  Cjis  not  empty,  then  both  CpCjOontain 
2'"  ' eodewords.  For  any  veetor  x  inF/,  let  d^=A{x,C^)  and  dj^=d{x,Cj^).  Also  let 
D=max(  dy ,  )•  Then,  D  is  ealled  the  norm  of  C.  Norm  does  not  depend  on  the  ehoiee  of 
X  or  j. 

b.  Definition  of  a  Normal  Code 

A  eode  is  normal  when  its  norm  satisfies  D  <  2i?  +  1 .  In  other  words  [22], 
given  a  eode  with  norm  D,  then  there  is  a  eoordinate  i  sueh  that,  for  any  veetor  x,  the  sum 
of  the  (i’s  from  x  to  the  nearest  eodeword  having  in  i-th  plaee  0  and  to  the  nearest 
eodeword  having  in  i-th  plaee  1,  eannot  be  greater  than  D. 

Having  defined  the  eritieal  eoneepts  of  the  norm  of  a  eode,  and  normal 
eodes,  we  ean  now  proeeed  to  the  seeond  method  of  eomputation  of  eovering  radius  that 
is  eombined  with  a  eode  eonstruetion  method. 
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Let  Cj  be  an  eode  with  eovering  radius i?j,  and  be  an 

R{r^,n2) coAq  with  eovering  radius  R^.  The  direet  sum  of  these  eodes  [11]  is  another 

eode  of  length  2"'  +2"^  veetors  m|v,  where  mGCj  and  vGCj.  Then,  this  direet  sum  is  a 


new  eode  with  eovering  radius  R^+R^.  Additionally,  if  Cj  and  Cj  are  normal,  we  ean 
eonstruet  their  amalgamated  direct  sum  [11]  that  is  a  eode  with  one  less  eoordinate,  one 
less  dimension,  and  R^+R^  eovering  radius. 

c.  Example  R^  +  R^ 

Consider  the  eode  C={00000,11000, 00111,11111}  that  is  the  direet  sum 
of  the  following  eodes:  Cj  ={00,11}  and  C2={000,111}.  Using  the  last  method  of  direet 

sum,  we  eonclude  that  the  eovering  radius  \sR  =  R^+  R^  =  2 . 

3.  3*^^*  Method  Using  Bounds 

Let  Cj  be  any  eode  of  length  2”'  and  b  any  veetor  of  the  same  length.  If  and 
C  =  Cj  u  (h  +  Cj  )  and  if  we  ean  find  a  veetor  y  ^  Cj  sueh  that  d{y,C^)  =  r ,  then  from  [11] 

r 

the  eovering  radius  of  C  is  at  least  [  —  ]. 

Piek  an  arbitrary  eode,  say  Cj  ={0000,1 100,001 1,1 1 1 1},  we  ean  ealeulate  the 
eovering  radius  of  eode  C  =  CjU(h  +  Cj)  (Table  7)  using  the  method  we  just 
introdueed.  The  eode  we  use  is  a  random  eode  with  no  speeifie  properties. 
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We  picked  a  vector  ^  Cj ,  and  we  construct  the  code  C  =  Cj  u  (h  +  Cj) .  Choosing 
a  vector  Cjwith  (i(j,Cj)  =  1  and  using  the  3'^‘*  method  of  computation,  we  conclude 


that  the  covering  radius  of  Cis  at  least 


=  1, 


Thus,  a  lower  bound  of  the  covering 


radius  of  C  is  1 . 

It  is  very  difficult  to  find  the  covering  radius  of  a  large  code,  or  even  to  bound  it 
[18],  [22],  Therefore,  in  the  majority  of  the  cases,  the  method  for  the  computation  of 
the  covering  radius  is  very  useful. 


Table  7.  3'^'*  method  of  Covering  Radius  computation 


Codewords  of  Cj 

Vector  h  ^  Cj 

Codewords  of 

C  =  Cj  V/'  (h  +  Cj  ) 

Vector  y  ^  Cj 

{d{y,C,)  =  \) 

0000 

0000 

1100 

1100 

0011 

0011 

1010 

nil 

1000 

nil 

1010 

0110 

1001 

0101 

4.  4“*  Method  Using  Norm 

This  method  relies  on  Theorem  1  [11], 


a  covering  radius  p  < 


2 


.  The  equality  holds 


which  states  that  every  code  of  norm  has 
for  normal  codes. 
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C.  COVERING  RADIUS  FOR  1^^  ORDER  REED-MULLER  CODES 

Recall  that,  R(r,m)  is  an  rth  order  Reed-Muller  code  of  length  2“ ,  and  p(r,m)  is  its 
covering  radius.  One  of  the  challenging  problems  in  coding  theory  is  to  find  precisely  the 
covering  radius  of  1*‘  order  Reed-Muller  codes. 

The  first  expression  for  p(\,m)  was  published  in  1978  [22]  . 

m  ^ 

p(\,  m)  =  2”  '  -  2  ^  for  even  m, 

m-l  m  ^ 

2«.-i  _  2^  <  m)  <  2"-*  -  22^  for  odd  m. 

For  the  first  odd  values  of  m,  we  have  that  yo(l,l)=0,  yo(l,3)=2,  p{\,5)=\2  (also 
proved  in  [8])  and  yo(l,7)=56  (also  proved  in  [14]).  An  easy  but  unsafe  conclusion  [14] 
was  that  with  odd  values  yo(l,2t-l-l)  is  equal  to  -2‘ ,  thus  to  the  lower  bound  of  last 
inequality  . 

In  1983,  the  last  conjecture  was  finally  disproved  [24],  and  it  was  shown  that: 

m-l 

p{l,m)  >  2'”  '  ^  oddm  >  5  .  In  1990,  a  correction  of  this  proof  is  also  provided 

[26]. 

D,  COVERING  RADIUS  FOR  ORDER  REED-MULLER  CODES 

One  of  the  first  detailed  studies  to  find  the  covering  radius  for  2"‘*  order  Reed- 
Muller  codes  was  in  [15],  where  it  was  proved  that  p{2,6)=\%.  In  the  same  paper,  some 
bounds  are  also  provided: 

36  <  p{2, 7)  <  46,  and  p(2, 8)  >  72  . 

Recently,  in  [27]  a  new  upper  bound  of  2"‘*  order  Reed-Muller  codes  was 
published:  p(2, m)  <  2“  '  -  Vl52^  -i-  0(1) . 
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E, 


COVERING  RADIUS  FOR  ifTH  ORDER  REED-MULLER  CODES 


Some  known  results  for  rth  order  Reed-Muller  eodes  are  shown  below. 

In  the  following  trivial  oases,  we  have: /?(«,  m)  =  0, /?(«-!,  m)  =  1, 
and  p{m  -2,m)  =  2. 

In  [13],  it  is  proved  that: 

p(m -3,m)  =  m  +  2,  for  m  even  and  m  >  3  ,  and 
p(m  -  3,m)  =  m  +  l,  for  m  odd  and  m>3. 

F.  CHAPTER  SUMMARY 

In  this  chapter,  the  concept  of  covering  radius  of  a  code  is  introduced.  In  addition, 
some  methods  of  covering  radius  computation  are  presented  and  finally  some  known 
results  for  Reed-Muller  codes  are  reported.  In  the  next  chapter,  a  new  simplified 
algorithm  of  fast  generation  of  all  order  and  some  of  order  Reed-Muller  codes  is 
analyzed  and  a  fast  construction  of  a  linear  subcode  with  good  properties  is  presented  and 
analyzed.  In  addition,  the  “reverse”  of  this  new  algorithm  is  presented. 
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V.  FAST  ALGORITHM  OF  GENERATION  OF  ORDER 

REED-MULLER  CODES,  LINEAR  SUBCODES  WITH  GOOD 
PROPERTIES,  AND  THE  “REVERSE”  ALGORITHM 

A,  FAST  GENERATION  OF  1^^  ORDER  REED-MULLER  CODES 

Comparing  Tables  4  and  5,  and  the  eonstrueting  method  of  Reed-Muller  eodes, 
we  notiee  that  all  of  the  1®*  order  Reed-Muller  eodes  are  Affine  Boolean  Funetions.  Also, 
all  U*  order  Reed-Muller  eodewords  are  balaneed,  exeept  the  all  O’s  and  all  I’s 
eodewords.  The  eonstruetion  of  these  eodewords  using  a  eonventional  method  is  time  and 
memory  eonsuming.  Therefore,  a  new  algorithm  for  fast  generation  is  introdueed  in  this 
chapter.  The  algorithm  is  useful  for  hardware  coding  applications. 

Using  a  Lemma  in  [28]  which  states:  “An  affine  function  in  more  than  2  variables 
is  a  linear  string  made  up  of  the  8  4-bit  blocks:  rj  =  {yl=0000,  5=0011, 

5=1100,  C=1001,  C=0110,  £)=0101,  £)=1010  }  in  a  block  sequence 

I ^ ,  1 2  ,  •••,  1 2"  ^  given  as  follows: 

The  first  block  /j  is  one  of  A,  A, B,B,C,C,DovD. 

The  second  block  is  either  /j  or  /j . 

The  next  two  blocks  are  /j ,  or  1^,1^  ■ 

The  next  four  blocks  ,  /g ,  /^ ,  /g  are  /j ,  ,  /g ,  1 4  or  /j ,  /j  ,1^ ,  1 4 . 

The  last  2”^^ blocks  2  "  1  ’  •  •  •  ’  2  ^ ^ 2”-^ 

P  n -2  \  rp  „ 

We  can  construct  all  order  Reed-Muller  codes  using  the  algorithm  described 
below.  In  our  case  when  a  1  occurs,  we  complement  and,  when  0  occurs,  we  just  copy  the 
block  as  it  is. 
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1,  New  Algorithm  for  Fast  Generating  1**  Order  RM  Codes 

Step  1 

We  begin  with  the  eodewords  of  f?(l,2)  that  are  identieal  to  the  4-bit  bloeks  used 
in  previous  lemma:  rj  =  {yl=0000,  ^=1111,  5=0011,  5=1100,  C=1001,  C=0110, 
5»=0101,  D=1010}. 

Step  2 

We  construet  the  following  coneatenation  for  eaeh  5(1,2)  eodeword:  |  7j  in 

order  to  eonstruct  the  5(1, n)  eode.  The  first  part  of  this  strueture  will  play  the  role  of 
“guide”  word. 

Step  3 

Starting  from  the  leftmost  bit  of  “guide”  word,  we  just  eomplement  the  bits  of 
right  part  when  we  find  1  and  just  repeating  these  bits  when  we  find  0,  until  we  take  the 
last  rightmost  bit  of  “guide”  word. 

We  repeat  step  3  for  every  bloek  of  Tj  using  every  “guide”  word.  In  Table  8,  we 
generate  5(1,3)  using  the  new  algorithm  for  fast  generating  order  RM  eodes. 
Therefore,  for  this  ease,  we  repeat  step  3  twice  since  there  are  two  “guide”  words  for 
every  block  of  .  On  the  contrary,  in  Table  9,  step  3  is  repeated  four  times, 

since  =  F/ "  =  F/  =  {00, 1 1, 0 1, 1 0} . 

2,  Example  R(l,3) 

Using  the  above  algorithm  we  construct  5(1,3). 
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Table  8. 


Fast  Generation  of  i?(l,3) 


Step  1 

(^(1,2)) 

step  2 

step  3 

(7?(1,3)) 

0000 

0|0000 

00000000 

1 10000 

00001111 

1111 

0|1111 

11111111 

llllll 

11110000 

1100 

0|1100 

11001100 

1|1100 

11000011 

0011 

0|0011 

00110011 

1|1100 

00111100 

1001 

0|1001 

10011001 

1|1001 

10010110 

0110 

0|0110 

01100110 

1|0110 

01101001 

1010 

0|1010 

10101010 

1|1010 

10100101 

0101 

0|0101 

01010101 

1|0101 

01011010 

3,  Example  R(l,4) 

Using  the  same  algorithm  we  eonstrueti?(l,4). 


Table  9 .  F ast  Generation  of  i?(  1 ,4) 


Step  1 

(^(1,2)) 

step  2 

step  3 

(^(1,4)) 

0000 

0010000 

0000000000000000 

11 10000 

0000111111110000 

01 10000 

0000000011111111 

1010000 

0000111100001111 

1111 

00|1111 

1111111111111111 

lllllll 

1111000000001111 

... 

1100 

00|1100 

1100110011001100 

11|1100 

1100001100111100 

... 

0011 

0010011 

0011001100110011 

... 

1001 

00|1001 

1001100110011001 

... 

0110 

0010110 

0110011001100110 

... 

1010 

00|1010 

1010101010101010 

... 

0101 

0010101 

0101010101010101 

... 

The  eomplexity  of  eonstrueting  the  1®*  order  Reed-Muller  eodes  using  this 
algorithm  is  signifieantly  lower  than  the  eomplexity  of  the  method  that  is  introdueed  in 
Chapter  III,  by  using  Boolean  polynomials. 
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In  addition,  it  is  obvious  that  this  compact  representation  of  order  Reed-Muller 
codewords  is  highly  memory  efficient  beeause  it  can  actually  store  a  great  amount  of 
information  in  a  small  word.  For  example,  using  a  “guide”  word  of  8  bits,  we  can 
compress  a  codeword  of  512  bits  to  a  string  of  12  bits.  The  compression  ratio  for  each 
codeword  in  this  example  is  43:1,  and  the  memory  saving  is  97.65%.  The  compressed 
string  includes  all  the  information  of  the  expanded  codeword,  and  moreover,  as  we 
analyze  below,  using  the  “reverse”  algorithm,  we  can  reconstruct  a  damaged  codeword, 
correcting  some  errors  occurred  during  the  transmission. 

B,  HARDWARE  IMPLEMENTATION  OF  ALGORITHM 

In  general,  in  our  algorithm,  in  order  to  store  a  compact  representation  of  2"  -bits 
codeword,  n+\  bits  are  needed.  This  implies  that  the  storage  ratio  is 

bits  of  complete  codeword  ,  2"  ,  ,  ,  .  . 

- :  1  = - :  1 ,  and  the  storage  saving  is 

bits  of  compact  codeword  n  +  \ 

bits  of  compaet  codeword  ^  .  ,  .  ,  , 

(1 - )%  =  (1 - )%.  It  IS  obvious  that  the  storage  ratio,  and 

bits  of  complete  codeword  2" 

the  storage  saving  are  very  high.  The  critical  point  is  that  the  fast  generation  of  complete 
codewords  from  eompact  form  cannot  be  effieiently  supported  by  a  program  running  on  a 
conventional  computer.  On  the  other  hand,  the  hardware  implementation  of  this 
expansion  (see  Figure  6,  for  the  case  of  n=3)  is  faster  and  more  compact. 

The  logic  circuit  of  Figure  6  generates  only  one  eodeword  at  a  time.  In  order  to 
obtain  the  whole  code,  we  have  to  repeat  this  circuit  for  each  word  of  either  I|  or  Tj  and 
for  each  “guide”  word. 
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Figure  6.  Hardware  implementation  of  algorithm  (n=3) 

The  exclusive  OR  gates  implemented  in  Figure  6,  either  complements  or  leaves 
uncomplemented  the  corresponding  bits  depending  on  the  value  of  inputs  54 .  If  ^4  =  1 , 

the  output  of  the  gate  is  complemented,  otherwise  stays  unchanged. 

The  number  of  two-input  exclusive  OR  gates  that  are  needed  for  the 
implementation  of  our  algorithm  is  2"  -  4 ,  where  n  is  the  number  of  variables  used. 
Although  exponential  in  n,  this  is  close  to  minimal  mostly  because  2"  outputs  are 
needed,  four  of  which  are  driven  directly  by  their  inputs  and  thus,  require  no  gate.  The 
delay  associated  with  this  logic  circuit  is  also  small. 

From  the  above,  we  conclude  that  our  conversion  algorithm  gives  to  any 
communication  user  the  ability  to  produce  complete  low  order  Reed-Muller  codewords 
on-the-fly  from  a  compressed  representation. 
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C.  FAST  GENERATION  OF  ORDER  REED-MULLER  CODES 

On  the  other  hand,  fast  generation  of  order  Reed-Muller  eodes  is  more 
eomplieated.  This  problem  is  eomparable  to  the  eonstruetion  of  all  n-variable  quadratie 

n*' 

funetions:  2^  ^  ^  .  We  just  demonstrate  the  fast  eonstruetion  of  R(2,3),  sinee  the 
generation  of  RM(2,n)  for  n>3  is  quite  eomplieated,  and  we  have  not  been  able  to  aehieve 
it  in  its  generality. 

We  define  r2  =  {E=1000,  E=0111,  F=0001,  F=1110,  G=0100,  G=1011, 

//=0010,  F=1101}. 

Any  eodeword  of  R(2,3)  has  the  strueture  Tj  |  Tj  or  \  as  mentioned  in  [29]. 

9 

Thus,  in  Table  10,  we  see  this  fast  generation.  This  way  of  eonstruetion  is  less 
eomplieated  and  less  memory  eonsuming  that  the  normal  way. 
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Table  10.  Fast  Generation  of  i?(2, 3) 


0000^ 

nr, 

T \T 

nil 

00001111 

10000111 

0011 

00000011 

10000001 

1100 

T, 

00001100 

10001110 

1001 

00001001 

10000100 

0110 

00000110 

10001011 

0101 

00000101 

10000010 

1010  j 

00001010 

10001101 

1000  ’ 

11111111 

01110111 

0111 

11110011 

01110001 

0001 

11111100 

01111110 

1110 

11111001 

01110100 

0100 

T2 

11110110 

01111011 

1011 

11110101 

01110010 

1011 

11111010 

01111101 

0100  . 

... 

... 

D,  FAST  GENERATION  OF  LINEAR  SUBCODES  WITH  GOOD 

PROPERTIES 

Having  fast  eonstructed  all  order  Reed-Muller  codes  using  the  eight  4-bit 
blocks:  7;  =  {H=0000,  H=llll,  5=0011,  5=1100,  C=1001,  C=0110,  5)=0101, 
£>=1010}  and  the  given  algorithm,  we  demonstrate  a  fast  generation  of  5(2,3)  using  the 
eight  4-bit  blocks:  r2  =  {^=1000,  5=0111,  5=0001,  5=1110,  G=0100,  G=1011, 
//=0010,  ^=1101}. 

Again  using  the  algorithm: 
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1,  Algorithm 

Step  1 

We  begin  with  the  4-bit  bloeks  given  above:  r2  =  {ii  =1000,  £'=0111,  £=0001, 

£=1110,  G=0100,  G=1011,  //=0010,  ^=1101} 

Step  2 

We  construct  the  following  concatenation  for  each  of  blocks:  \  in  order 

to  construct  a  new  category  of  error  correction  codes  with  good  properties.  The  first  part 
of  this  structure  plays  the  role  of  “guide”  word. 

Step  3 

Starting  from  the  leftmost  bit  of  “guide”  word,  we  complement  the  bits  of  right 
part  when  we  find  1  and  repeat  these  bits  when  we  find  0,  until  we  reach  the  last 
rightmost  bit  of  “guide”  word. 

We  repeat  step  3  for  every  block  of  using  every  “guide”  word. 

We  prove  that  the  properties  for  this  construction  hold  for  any  n.  Therefore,  all 
codewords  of  any  such  construction  are  of  the  form:  affine +  x^_^x^  .  Consequently,  the 

sum  of  any  two  codewords  is  an  affine  function,  and  also  the  sum  of  any  three  codewords 
belongs  to  the  code. 

2.  Example  R(2,3)  Subcode 

Using  the  above  algorithm,  we  construct  the  new  subcode  as  shown  in  the  Table 

11. 
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Table  1 1 .  Fast  Generation  of  a  i?(2,3)  subeode 


Step  1 

Step  2 

step  3 

1000 

0|1000 

10001000 

1 11000 

10000111 

0111 

0|0111 

01110111 

1|0111 

01111000 

0001 

0|0001 

00010001 

1 10001 

00011110 

1110 

0|1110 

11101110 

1|1110 

11100001 

0100 

0|0100 

01000100 

1|0100 

01001011 

1011 

0|1011 

10111011 

1|1011 

10110100 

0010 

0|0010 

00100010 

1|0010 

00101101 

1101 

0|1101 

11011101 

1|1101 

11010010 

3.  Example  R(2,5)  Subcode 

Using  the  same  algorithm,  we  generate  another  eode  that  has  32  eodewords  and 
some  important  properties,  as  deseribed  below.  Table  12  shows  the  Truth  Table  and 
Algebraic  Normal  Form  of  this  eonstruction: 
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Table  12.  Fast  Generation  of  i?(2,5)  subeode 


step  2 

step  3 

Algebraic  Normal  Form 

00|1000 

1000100010001000 

1  +  X4  +  X3  +  X3X4 

11|1000 

1000011101111000 

1  +  X4  +  X3  +  X3X4  +  Xj  +  Xj 

01|1000 

1000100001110111 

1  +  X4  +  X3  +  X3X4  +  Xj 

10|1000 

1000011110000111 

1  +  X4  +  X3  +  X3X4  +  Xj 

0010111 

0111011101110111 

X4  +  X3  +  X3X4 

11|0111 

0111100010000111 

X4  +  X3  +  X3X4  +  Xj  +  Xj 

0010001 

0001000100010001 

X3X4 

11 10001 

0001111011100001 

X3X4  +  Xj  +  Xj 

... 

00|1110 

1110111011101110 

X3X4  +1 

0010100 

0100010001000100 

X3X4  +  X4 

... 

00|1011 

1011101110111011 

X4  +  X3X4  + 1 

0010010 

0010001000100010 

X3  +  X3X4 

... 

00|1101 

1101110111011101 

X3  +  X3X4  + 1 

... 
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All  codewords  in  this  construction  are  affine  funetions  with  the  termx3X4.  In 
addition,  there  is  an  even  number  of  I’s  in  every  eodeword  of  this  eonstruction.  The  first 
property  implies  that  the  sum  of  any  two  eodewords  is  an  affine  function.  An  interesting 
property  of  this  error-eorrecting  eode  is  that  xoring  any  three  codewords  gives  another 
eodeword.  In  addition,  the  minimum  distanee  d  of  this  subeode  is  8. 

4,  Theorem 

All  codewords  of  any  subcode  generated  by  this  algorithm,  are  of  the  form 
affine + 

Before  we  prove  the  theorem  we  have  to  present  an  algorithm  for  ealeulating  the 
Algebraie  Normal  Form  from  the  Truth  Table  of  a  funetion  and  viee  versa  [30].  Let 
D  -  \_d  Q  d  ^  d  2  ■■  -  d  ho,  the  coeffieient  vector  of  the  polynomial  representing 

the  Boolean  funetion  /  (the  theorem  that  helps  us  calculate  the  eoeffieient  veetor  is 
presented  below).  If  d^=\,  where  0  <  t  <  2”  - 1 ,  then  the  monomial 

X[' X2N..x^"“'i  appears  in  the  Algebraic  Normal  Form  of  f  On  the  contrary, 
whent/;  =0,  no  monomial  appears,  where  (/o,/j,4’-"’4-i)  the  binary  representation  of 
pointer  i . 


a.  Example  of  Calculating  the  ANF  of  a  Function 

£>  =  [0  010001  1],  means 

<io=0,  t/j=0,  d^  =  1,  =  0,  =  0,  (ij  =  0,  (ig  =  1  d.j=\.  We  conclude  that: 

•  due  to  ^2  1000000  in  binary  representation),  one  of  the 

monomials  that  appears  in  the  Algebraic  Normal  Form 

0  1  0  0  0  0  0  0 

=x,. 

•  due  to  t/j  (i=10100000  in  binary  representation),  one  of  the 

monomials  that  appears  in  the  Algebraic  Normal  Form 

is  xlx°xlx°x^x°x^xj  =  XqXj  . 
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Finally,  the  Algebraic  Normal  Form  of  the  given  coefficient  vector 
is  Xj  +  XjXj  +  XqXj  +  XqXjXj  .  Now,  we  have  to  connect  the  coefficient  vector  with  the  Truth 

Table  of  the  function,  using  the  theorem  in  [30].  This  theorem  states  that  if  we  have  an  n- 
variable  Boolean  function  f,  and  D  the  coefficient  vector  of  this  function, 
then  D  =  f*A^,  where 

(A  A  ^ 

4=  °  “  and4=[l]. 

lo 


b.  Example  of  Calculating  the  Coefficient  Vector 

Given  a  Truth  Table  of  a  3-variable  Boolean  function  /  =01 100101  and 

working  in  accordance  to  the  above  theorem,  we  can  obtain  the  coefficient  vector.  Since, 

11111111 

0  10  10  10  1 

0  0  1  1  0  0  1  1 

0  0  0  1  0  0  0  1 

4  = 

'  0  0  0  0  1  1  1  1 
0  0  0  0  0  1  0  1 

0  0  0  0  0  0  1  1 

0  0  0  0  0  0  0  1 

we  obtain  Z)  =  [0  1  10001  0]. 

Our  previous  theorem  claims  that  all  codewords  of  any  such  construction 
are  of  the  form;  affine  +  x„_jX„  . 
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c.  Proof  of  Theorem 

Indeed,  every  function  of  our  construction  corresponds  to  coefficient 

vectors  of  the  form:  D  =  [d^  I  d^  0  0  0  d^...0...d^  ...0...]  ,  where: 

2" 

1.  t/o  can  be  either  1  or  0  since  the  bit  of  our  codewords  is  either  1 
or  0  and  the  1®*  column  of is[l  0  0  0...]^. 

2.  dy  can  be  either  1  or  0  since  the  first  2  bits  of  our  codewords  are 
00,  01,  10  or  11  and  the  2"*^  column  of  ^4^  is  [l  1  0  0  0...]^  . 

3.  ^2  either  1  or  0  since  the  first  three  bits  of  our  codewords 

are  000,001,111,110,100,011,010  or  101  and  the  column  is[l  0  10  0...]^. 

4.  can  only  be  1  since  f  consists  of  words  of  odd  number  of  I’s 

and  the  4**'  column  of  is  [l  1  1  1  0  0  0  0 . .  . 

5.  can  be  either  1  or  0  since  the  first  bit  and  the  2"  '  th  bit  of  our 
codewords  are  00,  01,  10  or  11  and  5**' column  of  y4^is[l  00010001000  1...]^ 

For  the  other  bits  of  D ,  except  2"  th  bits,  it  is  obvious  that  they  are  all  O’s. 
On  the  other  hand,  all  2"th  bits  of  Dean  be  either  1  or  0.  That  format  of  coefficient 
vector  confirms  that  the  Algebraic  Normal  Form  of  our  construction  is  affine +  x^_^x^. 

QED 

E.  THE  DECODING  “REVERSE”  ALGORITHM 

Reversing  the  algorithm  introduced  at  the  very  beginning  of  this  chapter,  we  show 
that  not  only  we  can  highly  compress  any  codeword  of  order  Reed-Muller  codes,  and 
of  new  construction  of  subcodes  of  2"‘*  order  Reed-Muller  codes,  but  we  can  also 
reconstruct  a  damaged  codeword,  correcting  some  errors  that  occurred  during 
transmission  or  storage. 
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1,  Conjecture 

This  new  correction  method  can  correct  n-2  errors,  or  similarly  the  number  of 
“guide”  word  bits. 


The  general  compression  ratio  of  this  “reverse”  algorithm,  as  it  is  already 


mentioned,  is - :  1 ,  and  the  memory  saving  is 

n  +  1 


r 


n  +  \ 


1- 

V  2” 


%  .  It  is  obvious  that,  for  high 


n,  the  compression  ratio  is  extremely  high.  For  example,  we  can  imagine  the  memory 
saving  in  a  realistic  case  for  n=\5,  where  we  can  compress  2'^  =32768  bits  to  only  16 
bits,  without  losing  any  information  of  the  codeword.  The  memory  saving  in  this 
particular  case  is  99.95%.  These  calculations  highlight  the  importance  of  this  algorithm  in 
environments  where  the  memory  efficiency  is  critical. 


2,  Algorithm 

Step  1 

We  split  the  word  in  two  halves,  and  both  of  these  halves  in  halves  and  so  on, 
until  we  reach  4  bit  chunks. 

Step  2 

We  xor  bitwise  the  first  two  halves,  and  using  the  majority  value  of  either  O’s  or 
I’s,  we  obtain  the  rightmost  bit  of  “guide”  word.  At  the  same  time,  the  minority  of  either 
I’s  or  O’s  indicates  the  probable  positions  of  errors  in  both  halves  of  our  word.  It  is 
obvious  that  on  first  xoring  we  either/both  miss  some  errors  due  to  double  errors  occurred 
on  two  xored  bits,  or/and  over  count  some  of  them  due  to  the  fact  that  error  candidates 
are  in  both  halves. 

In  order  to  accurately  locate  and  correct  all  of  the  errors,  we  xor  the  other  halves, 
and  we  work  as  described  on  the  second  step.  The  bit  positions  that  take  the  majority  of 
candidate  errors  are  the  errors. 

Our  decision  about  the  position  of  errors  can  be  verified  by  our  construction  of  the 
Reed-Muller  code  used.  It  is  known  that  using  our  algorithm,  all  1*^^  order  Reed-Muller 
codes  can  be  generated  by  I|  set  of  words,  and  all  subcodes  of  2"‘*  order  Reed-Muller 
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codes  that  we  quiekly  generated,  by  set  of  words.  Therefore,  all  4-bits  words,  after  the 
very  last  split,  should  be  either  of  I|  set,  in  our  eonstruetion  of  1*‘  order  Reed-Muller 
eodes,  or  set,  in  our  eonstruetion  of  subset  of  order  Reed-Muller  eodes.  Note,  all 
the  Tj  set  of  words  has  distance  1  or  3  from  the  Tj  set  of  words. 

Having  eorreeted  all  n-2  errors,  we  finally  obtain  the  eomplete  eompressed  word. 

It  is  obvious  that  the  eompression  ratio  is  as  high  as  the  size  of  “guide”  word. 

a.  Example  1 6  Bits 

Suppose  we  transmit  the  eodeword  1101001011010010,  and  we  aetually 
reeeive  the  word  1111001010010010.  This  word  has  two  errors  on  3rd  and  10th  bits. 
Splitting  the  reeeived  word  in  two  halves,  we  obtain  11110010  |  10010010.  Xoring  these 
halves  bitwise,  we  take  01100000.  This  string  gives  us  the  information  that  the  rightmost 
bit  of  “guide”  word  is  0,  and  errors  might  oeeur  in  the  2nd  bits  of  one  of  the  halves  (2nd 
or  10th  bit  of  the  word),  and  in  the  3rd  bits  of  one  of  the  halves  (3rd  or  11th  bit  of  the 
word). 

In  order  to  deteet  in  whieh  of  the  first  halves  the  errors  loeated,  we  xor  the 
subsequent  halves  bitwise.  Thus,  for  the  left  halves  we  obtain  1101,  and  the  information 
we  obtain  is  that  the  left  most  bit  of  our  “guide”  word  is  1 ,  and  the  probable  errors  are  in 
3rd  or  7th  bit  of  our  word.  Working  identieally  for  the  right  halves,  we  obtain  1011,  and 
the  information  we  obtain  is  that  the  probable  errors  are  in  2nd  or  6th  bit  of  right  half 
(10th  or  14th  bit  of  our  word).  Combining  the  information  of  three  xorings,  getting  two 
votes  for  3rd  and  10th  positions,  we  eonelude  that  the  errors  are  in  3rd,  and  10th  bits. 
Thus,  the  eompressed  word  is  10|1 101. 

In  all  eombinations  of  n-2=4-2=2  errors  in  the  reeeived  word,  the  xoring 
manipulation  ean  inform  us  for  their  position.  In  ease  there  are  no  errors  in  the  reeeived 
word,  the  algorithm  proeeeds  without  the  eorreetion  proeess. 

b.  Example  32  Bits 

In  this  example,  we  use  32-bit  eodewords,  and  we  eorreet  three  errors  that 

oeeurred  in  the  same  set  of  4-bits.  Suppose  we  transmit  the  eodeword 
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10110100101101000100101101001011,  and  we  actually  receive  the  word 
10111010101101000100101101001011.  This  word  has  three  errors  at  the  5th,  6th,  and 
7th  bits.  Splitting  the  received  word  into  two  halves,  we  obtain  1011101010110100  | 
0100101101001011.  Xoring  these  halves  bitwise,  we  obtain  11110001111111.  This 
string  gives  us  the  information  that  the  rightmost  bit  of  the  “guide”  word  is  1 ,  and  errors 
might  occur  in  5th  bits  of  one  of  the  halves  (5th  or  21st  bit  of  the  word),  in  6th  bits  of 
one  of  the  halves  (6th  or  22nd  bit  of  the  word),  and  in  the  7th  bits  of  one  of  the  halves 
(7th  or  23rd  of  the  word). 

In  order  to  detect  in  which  of  the  first  halves  the  errors  are  located,  we  xor 
the  subsequent  halves  bitwise.  Thus,  for  the  left  16-bits  half  1011101010110100  we 
obtain  00001110,  and  the  information  we  obtain  is  that  the  middle  bit  of  our  “guide” 
word  is  0,  and  the  probable  errors  are  in  5**'  or  13**'  bit  of  our  word,  6*  or  14*''  bit  of  our 
word,  and  7**'  or  15**'  bit  of  our  word.  Working  identically  on  the  right  16-bit  half 
0100101101001011,  we  obtain  00000000,  and  there  is  no  useful  information. 

At  this  point,  the  information  we  have  for  the  position  of  errors  in  our 
word  seems  sufficient,  but  for  the  sake  of  the  completion  of  our  algorithm,  we  keep  on 
xoring  until  we  get  the  4-bits  sets.  Therefore,  xoring  the  very  first  8-bits  set  we  obtain 
0001,  and  the  information  we  obtain  is  that  the  leftmost  bit  of  “guide”  word  is  0,  and  the 
probable  errors  are  in  the  4th  or  8th  bit.  Xoring  the  next  8-bits  set  10110100  we  obtain 
1 1 1 1  and  there  is  no  usable  information. 

Combining  the  information  of  the  xor  processes,  we  obtain  two  votes  for 
5th  ,  6th  and  7th  positions,  we  conclude  that  the  errors  are  in  these  bits.  Thus,  the 
compressed  word  is  101|1011. 

In  all  combinations  of  n-2=5-2=3  errors  in  the  received  word,  the  xor 
manipulation  can  inform  us  of  their  position.  It  is  obvious  that  there  are  many  cases 
where  our  “reverse”  algorithm  can  correct  more  than  n-2  errors,  but  we  cannot  generalize 
based  on  these  cases  only.  In  case  there  are  no  errors  in  the  received  word,  the  algorithm 
proceeds  without  the  correction  process. 
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F.  CHAPTER  SUMMARY 

In  this  chapter,  a  new  simplified  algorithm  of  fast  generation  of  all  U*  order  and 
some  of  order  Reed-Muller  eodes  is  analyzed  and  a  fast  eonstruetion  of  a  linear 
subeode  of  order  Reed-Muller  eode  with  good  properties  is  presented  and  analyzed.  A 
hardware  implementation  of  this  algorithm  is  also  presented  for  n=3.  In  addition,  the 
“reverse”  of  the  algorithm  is  introdueed,  showing  at  the  same  time,  the  proeess  of 
deeoding.  In  Chapter  VI,  we  summarize  the  eonelusions  of  this  thesis  and  future  work  is 
proposed. 


52 


VI.  CONCLUSIONS  AND  FUTURE  WORK 


This  thesis  points  out  the  diffieulty  of  eompletely  estimating  a  eritieal  property  of 
error-eorreeting  eodes,  namely  the  eovering  radius  of  a  eode.  This  eovering  radius 
problem  plays  a  eritieal  role,  along  with  minimum  Hamming  distanee  and  deeoding 
eomplexity,  to  our  deeision  of  ehoosing  the  most  effieient  error-eorreeting  eode. 
Nevertheless,  even  though  it  is  a  well-defined  property  in  eoding  theory,  in  the  majority 
of  the  eodes,  it  ean  only  be  bounded  and  not  exaetly  ealeulated. 

Further,  in  this  thesis,  a  new  method  of  fast  generation  of  1®*  order  R{\,n)  Reed- 
Muller  eodes  was  introdueed.  This  method  seems  highly  memory  effieient  and  fast,  sinee 
we  generate  all  order  Reed-Muller  eodes  using  just  the  Tj  set  of  4-bit  words  and 

entire F2''  Afield.  For  example,  to  generate  2  2*  =  256 codewords  of  2^=128  bits 

length,  thus  R(l,7)  code,  we  just  need  the  whole  set  of  I|  (32  bits),  as  well  as  the 
entire =32  bits.  Furthermore,  the  fast  construction  of  2”'^  order  Reed- 
Muller  codes  using  both  7j,r2sets  of  4-bits,  is  another  method  that  can  efficiently  use 
memory.  In  addition,  this  algorithm  allows  the  use  of  a  compact  way  to  represent  low 
order  Reed-Muller  codes. 

In  this  thesis,  the  hardware  implementation  of  the  “expansion”  algorithm  for  each 
codeword  is  presented  (for  n=3).  The  complexity  of  this  logic  circuit  is  analyzed  and  we 
show  that  the  number  of  two-input  exclusive  OR  gates  that  are  needed  for  the 
implementation  of  our  algorithm  is  2"  -  4 ,  where  n  is  the  number  of  variables  used. 
Although  exponential  in  n,  this  is  close  to  minimal  mostly  because  2”  outputs  are 
needed,  four  of  which  are  driven  directly  by  four  inputs  and  thus,  require  no  gate. 
Without  doubt,  this  implementation  is  faster  than  any  common  software  running  on 
conventional  computers. 

In  addition,  it  is  obvious  that  this  compact  representation  of  R*  order  Reed-Muller 
codewords  is  highly  memory  efficient  because  it  can  actually  stores  a  large  amount  of 
information  in  a  small  word.  For  example,  using  a  “guide”  word  of  8  bits,  we  can 
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expand,  and  thus  compress  a  codeword  of  1024  bits  to  a  string  of  12  bits.  The 
compression  ratio  in  this  example  is  85:1,  and  the  memory  saving  is  98.83%. 

Reversing  the  algorithm,  we  show  that  not  only  can  we  highly  compress  any 
codeword  of  l'^^  order  Reed-Muller  codes,  and  of  a  new  construction  of  subcodes  of  2"*^ 
order  Reed-Muller  codes,  but  we  can  also  reconstruct  a  damaged  codeword,  correcting 
some  errors  occurring  during  the  transmission  or  storage.  This  new  correction  method 
can  correct  n-2  errors,  or  similarly  the  number  of  “guide”  word  bits.  It  is  obvious  that 
there  are  many  cases  where  our  “reverse”  algorithm  can  correct  more  than  n-2  errors,  but 
we  cannot  generalize  on  these  cases. 

The  compressed  string  includes  all  the  information  of  expanded  codeword.  We 

2" 

show  that  the  general  compression  ratio  of  this  “reverse”  algorithm  is - :  1 ,  and  the 

n  +  1 


memory  saving  is 


% .  It  is  obvious  that,  for  high  n,  the  compression  ratio  is 


extremely  high.  For  example,  we  can  imagine  the  memory  saving  in  a  realistic  case  for 
n=15,  where  we  can  compress  2'^  =  32768  bits  to  only  16  bits,  without  losing  any 
information  of  the  codeword.  The  memory  saving  in  this  particular  case  is  99.94%.  This 
estimation  highlights  the  importance  of  this  algorithm  in  environments  where  memory 
efficiency  is  critical. 

One  of  the  main  contributions  of  this  thesis  is  the  fast  generation  of  a  new  2"‘* 
order  Reed-Muller  subcodes  of  good  properties.  Even  though,  this  is  a  non-linear  category  of 
subcodes,  their  low  distance  d,  and  some  other  good  properties  make  them  worthy  of 
investigation.  Their  performance  in  communication-oriented  environments  can  be  simulated, 
and  further  investigated  in  a  future  work.  The  coding  gain  of  these  subcodes  must  be 
simulated.  It  is  also  recommended  to  implement  these  subcodes  in  devices  used  for  data 
storage.  The  usefulness  of  these  2"*^  order  Reed-Muller  subcodes,  might  be  the 
minimization  of  memory  errors. 

In  this  thesis,  it  is  proven  that  the  format  of  Algebraic  Normal  Form,  for  our  fast 
construction  of  subcodes  of  2“‘*  order  Reed-Muller  codes  is  affine  +  .  Therefore,  the 

sum  of  any  two  codewords  is  affine  function,  and  the  sum  of  any  three  codewords  is 
another  codeword. 
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The  applicability  of  both  algorithms  can  be  tested  in  a  variety  of  environments. 
For  example  in  digital  repeaters,  where  store  and  forward  process  takes  place,  and  where 
Automatic  Response  Request  (ARQ)  processes  are  needed,  instead  of  Forward  Error 
Correction  (FEC),  codewords  can  be  stored  in  compact  form,  and  transmitted  in  full 
representation.  The  storage  of  the  compact  form  can  last  until  the  transmitter  receives  an 
acknowledgement.  On  the  other  hand,  in  storage  processes,  both  algorithms’  usefulness  is 
indisputable. 

In  addition,  one  communication-oriented  application  that  can  take  advantage  of 
these  algorithms,  is  when,  through  a  process,  signal  conditions  can  be  measured,  and 
automatically  changes  the  error-correction  coding  to  match  current  link  quality. 

In  any  case,  logical  extension  of  this  thesis  would  include  a  computer  simulation 
on  the  performance  of  proposed  algorithms,  in  various  operational  environments. 
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